Distributed ETL
نویسنده
چکیده
This paper provides the motivation, implementation details, and evaluation of a lightweight distributed extract-transform-load (ETL) service designed for large scale ingestion of real-time data.
منابع مشابه
Interoperable Distributed Data Warehouse Components
Extraction, Transformation and Loading (ETL) are the major functionalities in data warehouse (DW) solutions. Lack of component distribution and interoperability is a gap that leads to many problems in the ETL domain, because these ETL components are tightly-coupled in the current ETL framework. Furthermore, complexity of components extensibility is another gap in the ETL area, because of the sa...
متن کاملBig-ETL: Extracting-Transforming-Loading Approach for Big Data
ETL process (Extracting-Transforming-Loading) is responsible for (E)xtracting data from heterogeneous sources, (T)ransforming and finally (L)oading them into a data warehouse (DW). Nowadays, Internet and Web 2.0 are generating data at an increasing rate, and therefore put the information systems (IS) face to the challenge of big data. Data integration systems and ETL, in particular, should be r...
متن کاملUsing Distributed Database Technology to Simplify the ETL Component of Data Warehouse
The increasing need for Decision Support Systems for business enterprises has lead to tremendous growth of Data Warehouses. Within large enterprises number of data sources is increasing; due to which Data Warehouses are getting more and more complex. The ETL componentone of the basic components of data warehousecan be made simpler with the use of Distributed Database technology in the developme...
متن کاملContainer-Managed ETL Applications for Integrating Data in Near Real-Time
As the analytical capabilities and applications of e-business systems expand, providing real-time access to critical business performance indicators to improve the speed and effectiveness of business operations has become crucial. The monitoring of business activities requires focused, yet incremental enterprise application integration (EAI) efforts and balancing information requirements in rea...
متن کاملIntegrating Data in near Real-time
As the analytical capabilities and applications of e-business systems expand, providing real-time access to critical business performance indicators to improve the speed and effectiveness of business operations has become crucial. The monitoring of business activities requires focused, yet incremental enterprise application integration (EAI) efforts and balancing information requirements in rea...
متن کامل